4 research outputs found
Comprehensive Training and Evaluation on Deep Reinforcement Learning for Automated Driving in Various Simulated Driving Maneuvers
Developing and testing automated driving models in the real world might be
challenging and even dangerous, while simulation can help with this, especially
for challenging maneuvers. Deep reinforcement learning (DRL) has the potential
to tackle complex decision-making and controlling tasks through learning and
interacting with the environment, thus it is suitable for developing automated
driving while not being explored in detail yet. This study carried out a
comprehensive study by implementing, evaluating, and comparing the two DRL
algorithms, Deep Q-networks (DQN) and Trust Region Policy Optimization (TRPO),
for training automated driving on the highway-env simulation platform.
Effective and customized reward functions were developed and the implemented
algorithms were evaluated in terms of onlane accuracy (how well the car drives
on the road within the lane), efficiency (how fast the car drives), safety (how
likely the car is to crash into obstacles), and comfort (how much the car makes
jerks, e.g., suddenly accelerates or brakes). Results show that the TRPO-based
models with modified reward functions delivered the best performance in most
cases. Furthermore, to train a uniform driving model that can tackle various
driving maneuvers besides the specific ones, this study expanded the
highway-env and developed an extra customized training environment, namely,
ComplexRoads, integrating various driving maneuvers and multiple road scenarios
together. Models trained on the designed ComplexRoads environment can adapt
well to other driving maneuvers with promising overall performance. Lastly,
several functionalities were added to the highway-env to implement this work.
The codes are open on GitHub at https://github.com/alaineman/drlcarsim-paper.Comment: 6 pages, 3 figures, accepted by the 26th IEEE International
Conference on Intelligent Transportation Systems (ITSC 2023
TRY plant trait database â enhanced coverage and open access
Plant traits - the morphological, anatomical, physiological, biochemical and phenological characteristics of plants - determine how plants respond to environmental factors, affect other trophic levels, and influence ecosystem properties and their benefits and detriments to people. Plant trait data thus represent the basis for a vast area of research spanning from evolutionary biology, community and functional ecology, to biodiversity conservation, ecosystem and landscape management, restoration, biogeography and earth system modelling. Since its foundation in 2007, the TRY database of plant traits has grown continuously. It now provides unprecedented data coverage under an open access data policy and is the main plant trait database used by the research community worldwide. Increasingly, the TRY database also supports new frontiers of traitâbased plant research, including the identification of data gaps and the subsequent mobilization or measurement of new data. To support this development, in this article we evaluate the extent of the trait data compiled in TRY and analyse emerging patterns of data coverage and representativeness. Best species coverage is achieved for categorical traits - almost complete coverage for âplant growth formâ. However, most traits relevant for ecology and vegetation modelling are characterized by continuous intraspecific variation and traitâenvironmental relationships. These traits have to be measured on individual plants in their respective environment. Despite unprecedented data coverage, we observe a humbling lack of completeness and representativeness of these continuous traits in many aspects. We, therefore, conclude that reducing data gaps and biases in the TRY database remains a key challenge and requires a coordinated approach to data mobilization and trait measurements. This can only be achieved in collaboration with other initiatives
Decoding EEG signals
In the context of designing a real-time brain-computer interface for playing a game using the OpenBCI Ultracortex "Mark IV" headset, this paper focuses on the work of the decoding subgroup. The primary responsibility is to analyse EEG data retrieved from the OpenBCI headset and classify the intention of the user. Our objective is to achieve a high-accuracy classification of the EEG signals. The paper is structured into three main sections: preprocessing, feature extraction, and classification. Multiple methods for preprocessing and classification of motor execution EEG signals will be analysed, striving to contribute to the real-time implementation of the project. The results of our work provides valuable insights for future research and development in this field.Bachelor Graduation ProjectElectrical Engineerin
TRY plant trait database - enhanced coverage and open access
10.1111/gcb.14904GLOBAL CHANGE BIOLOGY261119-18